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Abstract 


This study evaluates the impact of minimally trained tutors on the pass/fail 
ratio of middle school students in core subjects such as English, reading, math, 
or science. Because a traditional experimental design comparing students who 
receive a treatment with those who do not was not financially feasible, the 
study employed an alternative that has proven very successful when traditional 
control groups are not available. The within-program control group alterna- 
tive permits a comparison between those who receive more of a treatment and 
those who receive less. For this evaluation, students were divided into two 
groups based on the number of hours of tutoring they received. Tutored stu- 
dents were more likely to increase their grade to passing than could be expected 
by chance. Students in the group that received more tutoring were more likely 
to pass than those who received less tutoring. The within-program control 
group design gives us confidence that tutoring of middle school students by 
minimally trained community volunteers can be effective. 

Key Words: tutors, community volunteers, middle school, student academic 
achievement 
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Introduction 


Dropping out of school continues to be a major national problem. Re- 
cent statistics from the National Dropout Prevention Center (2004) conbrm 
the grim reality that dropouts are costing the country billions during their 
lifetimes in lost earnings and unrealized tax revenue. Dropouts earn less and 
are unemployed at a much higher rate than high school graduates. Harlow 
(2003) reports that 75% of state prison inmates are high school dropouts. Stu- 
dents with low academic achievement are twice as likely to become parents in 
high school and not complete their degree (Alliance for Excellent Education, 
2003). Staresina (2004) suggests that because there are so many long-term 
consequences for students who drop out of school, it is imperative that we 
implement strategies such as tutoring programs to improve students’ opportu- 
nities to complete high school. 

This research reports on the results of a tutoring program that uses mini- 
mally trained local volunteers to tutor middle school students who are at risk 
for dropping out of school. It provides an opportunity to examine a low-cost, 
highly effective way of using community volunteers to improve the academic 
achievement of middle school students. 

Review of Literature 

Dynarski and Gleason (1999) identified several promising program mod- 
els and strategies that helped reduce the dropout rate. The most successful of 
these programs were usually conducted for students in middle grades or earlier 
and were focused on specific students with targeted goals. 

There is little debate that tutoring for middle school students who are at 
risk for dropping out of school seems to be a good idea and is in accord with 
the findings about best practices for keeping students in school. McElvain and 
Caplan (2001) report that schools and communities see great hope in tutoring 
programs for middle school students; however, there has been little evidence 
to date that tutoring programs can work beyond the early grades and even less 
evidence that tutoring is effective using minimally trained community volun- 
teers during the regular school day. Most of the research on successful tutoring 
programs either focuses on early reading tutoring (Slavin, Karweit, & Mad- 
den, 1989; Wasik & Slavin, 1993) or reports on after-school programs that 
combine mentoring and tutoring (Cardenas, 1989; Huang, 2001; Leto, 1995). 
Programs with one-to-one tutoring using certified teachers appear to have larg- 
er effects than those using paraprofessionals or volunteers (Wasik, 1997), and 
thus the issue of cost is raised. 
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Volunteer tutors provide individual attention that most teachers cannot 
provide, especially as class size expands in response to tighter school budgets. 
Wasik and Slavin (1993) have found that one-to-one tutoring is the most ef- 
fective individual remedial strategy if implemented well. Tutoring for reading, 
especially for beginning readers, has been studied far more than tutoring for 
other subjects. Most studies of early readers conclude that tutors with more 
training and expertise have a greater impact (Cohen, Kulik, & Kulik, 1982; 
Shanahan, 1998; Wasik 1998; Wasik & Slavin, 1993). These programs, how- 
ever, are generally expensive and the samples tend to be small. 

Two recent studies that looked at tutoring programs for “at-risk” beginning 
readers found significant improvement using college students with mini- 
mal training (Fitzgerald, 2001) and community volunteers (Baker, Gersten, 
& Keating, 2000). The Fitzgerald study using college students also found 
a significant correlation between hours of contact and successful outcomes. 
Middle school students are also represented in the tutoring literature, but in 
much smaller numbers. One school district in Florida, however, discontinued 
its summer school for middle school students who failed subjects during the 
academic year and replaced it with a successful after-school tutoring program 
(Lacey, LeBlan, & Collins, 2000). The evaluation focused on implementation 
rather than outcomes. 

Reviews of effective reading tutoring programs identified a number of 
features that are critical to a successful program (Wasik, 1998; Moss, Swatz, 
Obeidallah, Stewart, & Greene, 2001): 

• intensity of tutoring — frequency, session length, and individualized; 

• structured sessions; 

• close coordination with teacher and classroom; 

• extensive tutor training — before and during course of tutoring; and 

• careful monitoring of the effectiveness of tutoring services. 

Description of Middle School Tutoring Program 

Building on the recommendations from the literature and because meta- 
analyses of the dropout literature (Jimerson, 2001; Jimerson, Anderson, & 
Whipple 2002) strongly suggest that grade retention is one of the most pow- 
erful predictors of dropout status, this tutoring program was established for 
students who were experiencing serious difficulty passing a course and thus at 
most risk. The tutoring program was part of a larger dropout prevention initia- 
tive of Community In Schools in central Texas where an AmeriCorps program 
is responsible for tutoring and mentoring middle school students. This study 
focuses on the tutoring component of the AmeriCorps program only. 
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The goal of the tutoring program was to assist students to pass core subjects 
(math, reading or English Language Arts, science) for which they had received 
a failing grade the previous year. Each participating school received one to 
four volunteer tutors who could elect to work either full- or part-time. Com- 
munity In Schools’ on-site program managers supervised the tutors and were 
available for consultations on an as-needed basis. Program managers were pri- 
marily social workers who helped the tutors understand the academic, social, 
and emotional needs of students. 

Teachers referred students to the tutoring program if they had failed a six- 
week grading period in the following subjects: math, English, reading, science, 
or social studies. Each tutor and student developed an individual plan for when 
and where tutoring would take place. Some students were tutored exclusively 
after school, others during class or in the library during an elective class such as 
band. Some focused on homework, others on practicing skills such as multi- 
plication or reading comprehension. Tutors were expected to tutor for at least 
one hour a week, but not all of the students received the same number of hours 
of tutoring. 

Methodology 

Participants in the program included tutors and students from one large 
urban and two smaller rural school districts. The majority of the participating 
campuses were inner-city schools, and all schools served a high proportion of 
low-income families. 

Tutors 

The 31 AmeriCorps tutors were a diverse group, though 84% were female. 
Fifty-eight percent were of European American heritage, 19% were African 
American, 23% were Hispanic, and 4% were of Asian American heritage. Col- 
lege graduates comprised only 13%, 52% had some college, 32% were high 
school graduates, and the remaining 6% earned a GED. The attrition rate for 
the volunteer tutoring program was 27%, considered to be within the normal 
range for national AmeriCorps programs. 

Most of the 31 AmeriCorps tutors began their service in September and 
October during the 200 1 -2002 school year and received five days of preservice 
training. The members who signed up later did not receive the same system- 
atic preparation and training. Five days of preservice training included one 
day devoted to learning how to tutor math and reading. Training to tutor was 
necessarily general, because tutors would be addressing many different subjects 
and three grades. Other days of training covered subjects such as how to work 
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in a school, working with early adolescents, and mentoring. Training contin- 
ued throughout the year with approximately four more hours of training in 
tutoring, especially math. Program managers provided on-the-job training in 
mentorship as well as tutoring, and they trained the tutors to encourage stu- 
dents to talk about any problems that seemed to keep them from focusing on 
their school work. Volunteer tutors met together regularly to share successes 
and learn more about how to tutor. 

Students 

The student sample is comprised of 256 middle school students (6th 
through 8th grades). Of the tutored students, 61% were male; 79% of the 
tutored population was eligible for the free/ reduced lunch program. Hispanic 
students comprised 61% of those tutored, 22% were African American, 13% 
were of European American heritage, 3% were other, and 1% did not list eth- 
nicity. Eighteen percent of the students were from homes in which English 
is not the primary language. Many of the tutored students were reported by 
their teachers to be working below grade level and/or have limited English 
skills. Approximately 88% of the students met the most stringent criteria for 
inclusion in the tutoring program — a failing six-week report card grade or fail- 
ure in a core subject the previous year. The rest of the sample, 12%, was at risk 
of failing a course because of borderline grades (70-73%), according to their 
teachers. 

Procedures 

In the classic experimental-control comparison, the control group does not 
receive any of the treatment. In this way the effectiveness of a treatment can 
be measured by comparing those who received it with a similar group who did 
not. The expense and difficulty associated with securing traditional control 
groups in three different school districts prohibited a traditional experimental 
design for this evaluation. The wide range of treatment received by the stu- 
dents in this evaluation suggested an alternative, however. Control groups are 
frequently difficult to work out in public school settings, so researchers in the 
field of education have devised an alternative design when a traditional control 
group is not feasible (Invernizzi, Rosemary, Juel, & Richards, 1997; Fitzgerald, 
2001). In this alternative method, a within-program control group is formed 
when a group of children is compared with a group of similar children who 
received the same treatment, but less of it. The alternative design essentially 
tests the effectiveness of a treatment by comparing those who received more 
of it to those who received less of it. “This alternative within-program control 
group is potentially a more stringent test of a treatment than the classic form 
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of comparing something to nothing. If statistically significant outcomes arise, 
they clearly can be directly attributable to what is happening in the program 
in conjunction with the amount of treatment that is provided” (Fitzgerald, 
2001 ). 

Volunteers used a computerized data collection system to record the type of 
service and hours of contact they had with their students. Time that the vol- 
unteer spent that was not direct contact with the student was not recorded for 
this evaluation. Thus time spent recording information or checking on grades 
or looking for a student was omitted. The intent was to measure only the time 
that the volunteer actually spent with their students. 

Progress was measured by comparing the previous year’s failing grade in a 
core subject (English, reading, math) or a failing six-week report card grade 
with the final grade the student received at the end of the current school year 
in the targeted subject. 

The students were divided into two groups based on the distribution of 
the number of hours of tutoring they received. Thus, half of the students re- 
ceived 13.25 hours of tutoring and the other half received 13.50 to 61 hours 
of tutoring. The two groups were similar in every other respect, but one group 
received more tutoring than the other. The primary reason for the difference 
between the two groups is that the group receiving less tutoring started tutor- 
ing later in the year because they did not fail in the first or second six-week 
grading periods. 

Results 

Figure 1 shows that the average reported six-week grade before tutoring was 
60; the average grade at the end of the year was 73. The final grade at the end 
of the year includes the previous lower grade. In many instances, the tutoring 
did not begin until after the student had failed more than one six-week grading 
period. Ethnicity and receiving free/ reduced lunch did not affect the results, 
but gender did. As in other studies, females tended to be more likely to pass 
than males ( x = 2.045, df= l, p = .004). The paired t-test was used in order 
to compare the mean of the initial six-week report card grade with the mean of 
the final grade in the subject for which the student received tutoring. A paired 
t-test showed that the tutored students made significant improvement from 
their initial six-week grade to the grade at the end of the year (t = 19.254, df= 
21 6, p < 0.00025, two-tailed). 

Researchers also look at the results to see if there were any differences in 
pre- and post-grades by subject or by grade level. There were no significant 
differences. 
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Figure 1 . Comparison of Average Pre-Grade with Final Grade 


Mean 



Figure 2 illustrates the rate of pass/fail where one equals a failed grade and 
two equals a passing grade. Because the bars represent the average rates of pass- 
ing or failing, the range for the mean pass/ fail score is approximately 1.1 to 1.7. 
Figure 2 includes students whose pre-grade was passing and whose final grade 
was failing. 

Figure 2. Comparison of Average Rate of Pass/Fail Before and After Tutoring 



1=FAIL 2=PASS 
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Again, researchers examined the results to see if there were any differences in 
the average pre- and post- pass/fail scores by subject or grade level. There were 
no significant differences. 

Figure 3 shows the results when the tutored students were divided into two 
groups based on the amount of tutoring they received. Approximately half 
of the students (120) in the tutoring program sample received between 1 and 
13.50 hours of tutoring. The other half (126) received between 14 and 61 
hours of tutoring. To test for tutoring effects on the rate of pass/fail for end of 
the year grades in either math, language arts, reading, science, or history, stu- 
dents who received less than 14 hours were compared to the second group who 
received 14 or more hours of tutoring. In this comparison (Figure 3), students 
who received more tutoring were compared to those who received less. 

Figure 3. Tendency Toward Pass/Fail by Students Who Received 
More Tutoring Compared with Students Who Received Less Tutoring 



Failed Passed 

Final Grades at Year’s End 


The two groups are similar across different grades, schools, and districts. 
Gender, age, poverty, and ethnicity were tested for contributions to differ- 
ences between the two groups, and the only significant difference was for 
free/reduced lunch (y 2 = 6.006, df= 1 ,p = 0.014). 
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The chi-square test is used to compare the distribution of frequency data 
collected in a study with the distribution that would be expected to occur by 
chance. This statistic suggests the impact of the number of hours on the final 
grade. In this study, we compared the frequency of failure rates of students 
who received more tutoring with the failure rates of students who received less 
tutoring. As Table 1 indicates, students who received less tutoring were signifi- 
cantly more likely to fail; those who received more tutoring were significantly 
more likely to pass (y 2 = 9.71, df= 1 ,p = 0.002). 


Table 1. Tendency Toward Pass/Fail by Hours of Tutoring Cross Tabulation 


Tendency Toward Pass/Fail 
Rate in Tutored Subject 

Total Hours Tutored 

Totals 

0-13.25 Hrs 

14 - 61 Hrs 

Count 

Failed % 

29 

39.2% 

31 

19.9% 

60 

26.1% 

Count 

Passed % 

45 

60.8% 

125 

80.1% 

170 

73.9% 

Count 

Total % 

74 

100.0% 

156 

100.0% 

230 

100.0% 


Another test of correlation was used to determine the size effect or strength 
of the correlation between the likelihood of passing or failing and hours tu- 
tored. This statistic helps answer the question of how much the tutoring 
contributed toward the increased number of students who passed. Pearson’s 
correlation was significant, with a respectable 21% effects size (r = .212, n = 
255 , p = 0.001, two-tailed). 

Discussion 

The results of the tutoring program are very promising. As both Figure 1 
and Figure 2 demonstrate, there is a significant increase in the number of stu- 
dents who achieved both a higher grade and a passing grade at the end of the 
year compared to the grade they had before tutoring began. There were no sig- 
nificant differences in subject areas or grade levels. 

In Figure 3, there was a higher tendency toward passing for students who 
received more tutoring. After testing for gender, age, poverty, and ethnicity 
for any significant differences between the two groups, a significant difference 
did emerge for free/reduced lunch. This difference is primarily attributable to 
the rural schools, who have a higher proportion of students who do not receive 
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free/reduced lunch than the more urban schools and whose volunteers deliv- 
ered an impressive number of hours to their tutored students. Other than the 
rural schools, however, students who received less tutoring are from the same 
schools as those who received more tutoring. In many instances, the students 
who had less tutoring had the same tutors as those who received more tutor- 
ing. In sum, the within-program control group appears to be a good, though 
not perfect, comparison group. 

The within-program control group alternative evaluation shows that the 
more tutoring students receive, the more likely they will pass the course for 
which they are receiving tutoring. Other data supports this conclusion as well. 
For example, those who enter the program after the first six weeks are signifi- 
cantly (p < .005) more likely to pass than those who enter the program later in 
the year. The comparison is weakened somewhat by the very slight overrepre- 
sentation of students ineligible for free/reduced lunches in the group receiving 
more tutoring; however, as noted earlier, the number of students who do not 
receive free/reduced lunch is somewhat mushy, because if nothing was record- 
ed for a student, he or she was recorded as not eligible for free/ reduced lunch. 
Many students were also receiving other types of public assistance, but did not 
apply for free/reduced lunch. This is especially true for intermediate students. 

More studies are needed to examine the relauonship between tutoring and 
academic achievement. Although this study has produced some interesting re- 
sults supporting the positive effects of tutoring, it is important to recognize the 
limitations of this study and to make suggestions for future studies. Data were 
not gathered that differentiated tutoring approaches. Future studies might 
discriminate between helping with homework and practicing skills such as 
reading or multiplication tables. There might be a difference among tutoring 
approaches. Another factor that might be examined is the difference between 
tutoring small groups of two to three students and one-to-one tutoring. 

Future studies may also want to examine the interaction between tutor and 
teacher. The information gathered in this study was not systematic enough 
to draw any conclusions, but there was strong indication that there were dif- 
ferences in relationships between tutors and teachers. Some teachers worked 
closely with the tutors, and others interacted infrequently with the tutors. 

Conclusion 

Although more studies need to be conducted, the within-program compari- 
son group strongly suggests that tutoring by minimally trained tutor/mentors 
increased the likelihood that a student would pass a core subject. The tutoring 
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program garnered many very positive comments from teachers who praised the 
program for “turning students around.” 

The results of this study have important implications for community after- 
school programs and volunteer tutoring of middle school students. At least 14 
hours of tutoring were required to help a student move from a failing grade to 
a passing grade. Minimally trained adult volunteers without a college educa- 
tion can provide enough academic support to increase the rate of passing for 
middle school students. 

This study lends support to the significant role that community volunteers 
can play in increasing the academic achievement of middle school students. 
Funding for programs that link community volunteers with students at risk 
of dropping out of school can make a difference in helping students pass their 
courses and stay in school. 
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